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J3ETHQD FOR TRACKING AT LEAST ONE OBJECT IN A SCENE 
Background Information 

The present invention is based on a method for tracking at 
least one object in a scene according to the species of the 
independent patent claim. 

Summary of the Invention 

The method according to the present invention for tracking at 
least one object in a scene, having the features of the 
independent patent claim, has the advantage that it generates 
a signaling as a function of the dwell time of an object at a 
particular location. In this way, an atypical behavior pattern 
in a monitored scene in which moving objects are usually 
present is detected immediately. This may result in a more 
rapid alarm and thus in better monitoring. In the process, 
dwelling objects that have made the transition from movement 
to standstill are able to be detected and then result in a 
signal . 

Advantageous improvements of the method for tracking at least 
one object in a scene, which are indicated in the independent 
claim, are rendered possible by measures and further 
refinements specified in the dependent claims. 

It is especially advantageous that the signaling, which is 
generated as a function of the counter reading, results in an 
alarm. This means that an alarm is generated when an object 
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remains stationary for a predefined period of time, the 
predef ineable time constituting a threshold value for the 
counter reading. 

The movement of a particular object is described by a list or 
a matrix; in one line, the image coordinates of the object in 
the x-direction are stored at different instants for the 
individual images of an image sequence and, in a second line, 
the y-values are stored, that is, the vertical values in the 
scene at these instants. The x-value and the y-value at a 
predefined time instant represent a motion vector, i.e., in 
the movement direction of an object. If this motion vector is 
zero, a standstill is detected and the counter incremented. 
The list may be dynamically managed or, if a predefined number 
of list locations has been processed, it is possible that 
cumulative values are carried over into a new list for this 
object. This list representation makes it possible to monitor, 
and thereby track, several objects simultaneously. This is 
then managed with the aid of a processor of the video 
monitoring and administered in the associated memory. A 
camera, which generates the image sequence, acts as imaging 
element. The images are produced here at relatively long 
intervals of half a second, for instance, so as to be able to 
detect the corresponding motions in a meaningful manner. Such 
motion vectors in a list may also be generated between images 
that do not follow each other immediately, for instance when 
the movements are very slow, which allows high resolution of 
the motion. This may be done dynamically, i.e., if no movement 
is detected, a counter may simultaneously be started while the 
comparison continues up to a certain number of image 
sequences, above which a standstill is then conclusively 
detected, and the counter reading ultimately becomes relevant. 

The list may then be newly initialized as soon as movement 
begins anew. If values for the object able to be detected by 
various object -detection methods are already available from a 
previous list, these may be carried over into the new list. 
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This also makes it possible to analyze an entire movement 
sequence, which then represents a very efficient method with 
respect to the memory resources . 

5 Furthermore, it is advantageous that a reference image is 

generated so as to recognize an object in a simple manner. To 
generate a time and object template, a so-called reference 
image must be obtained that, if possible, contains only the 
background of the scene, without tracked objects. This 

10 reference image is generally obtained when no object is 

present, for example from the next-to-last image. This image 
may then be adopted as reference. This method is useful, in 
particular, for a small number of objects, which also make 
only a brief appearance in the scene. However, if many objects 

15 are tracked over longer periods of time, a reference image is 
generated in such a way that, after having determined the 
object positions in the instantaneous image, the reference 
image is carried over into the remaining area from the 
next-to-last image. This is referred to as local adaptation of 

2 0 the reference image. 

The method according to the present invention is used in video 
monitoring, in particular, where at least one image generator, 
a processor, a memory and also output means are provided by 
25 which a signaling, such as an alarm, may then be implemented. 
However, the signaling may also be utilized as a signal for 
other systems. This video monitoring may be used to monitor a 
parking facility, in particular. 

3 0 Brief Description of the Drawing 

Exemplary embodiments of the present invention are shown in 
the drawing and explained in greater detail in the following 
description. 

35 

The figures show: 
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Figure 1 a block diagram of the video monitoring according to 

the present inventions- 
Figure 2 a flow chart of the method according to the present 
5 inventions- 
Figure 3 a first example of video monitoring; 
Figure 4 a second example of video monitoring; and 
Figure 5 a third example of video monitoring. 
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Specification 



15 Video sensors based on modern computer architectures are able 
to detect objects moving in a directional manner in image 
sequences of stationary cameras. The monitoring normally 
tracks the beginning point at which predefined threshold 
values with respect to segment distance or size are exceeded. 

20 Such exceeding is detected by changes in the image signal 
caused by the movement of objects such as persons, for 
example, whereupon a corresponding signaling or image 
recording takes place. In this manner, the objective of 
raising an alarm concerning an unauthorized entry is realized. 

25 

According to the present invention, it is now possible to 
fully track objects across a scene. An object entering the 
scene is detected very quickly as a direct ionally moving 
object and monitored in the scene until the object leaves the 

30 scene again, such monitoring also being known as tracking. 

This is shown in Figure 3. At location 13, a person enters the 
scene monitored by an image generator, that is, a video 
sensor, for example, or some other camera, such as a heat 
image camera. Since the evaluation of the video monitoring 

35 detects movement only, the object is not yet detected in the 

first image sequence. Only at instant 14, after a movement had 
been detected, was this object identified. At instant 15, the 

NY01 674238 v 1 4 



constantly moving object has left the monitored scene. 



Figure 4 shows a second scenario. Here, too, a person enters 
the scene at instant 14 and is detected as a moving object at 
instant 14. However, the person stops moving at instant 16 and 
comes to a standstill, whereupon the method according to the 
present invention starts a counter in order to monitor the 
dwell time. A signaling will then be generated as a function 
of the dwell time. This signaling may mean an alarm, for 
instance . 

Figure 5, in a third scenario, shows additional possibilities 
for a plurality of objects. An object 14 is detected as 
moving. At instant 17, a split is implemented here, that is, 
the object is split into two objects. This is detected by 
different motion vectors originating from the same object. 
Instant 18 shows a so-called merge, i.e., a merging of two 
objects, which may then lead to another split. This merge is 
caused by an additional object 19, which was detected as 
moving object 20. The first object leaves the scene at instant 
21, while the second object makes the transition from movement 
to standstill at instant 22. 

Figure 1 shows a block diagram of a video monitoring according 
to the present invention. An image provider, a monitoring 
camera 1 in this case, is connected to a processor 2. A memory 
3 is connected to processor 2 via a data input/ output. By 
means of a data line, processor 2 is connected to a control 4, 
which is connected to a loudspeaker 5 on one side and to a 
display 6 on the other side. 

Only one camera 1 is indicated here by way of example. 
However, a plurality of cameras may be provided so as to 
monitor several scenes simultaneously and have these operated 
by a processor 2. Furthermore, only one loudspeaker 5 and one 
display 6, which are used to output an alarm, are illustrated 
here by way of example. However, the signaling transmitted 
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from processor 2 to control 4 may be used as well. The method 
according to the present invention, which will now be 
elucidated on the basis of the flow chart shown in Figure 2, 
runs on processor 2. In method step 7, on the basis of the 
5 motion vector and with the aid of camera 1 and processor 2, a 
moving object is detected as shown in Figure 3. A list or 
matrix is prepared for this purpose in which each column, for 
instance, denotes a specific image in an image sequence, image 
sequences being separated by time intervals, such as one 

10 second, for example. Furthermore, the list has two lines 
defining the motion vector in a plane. This is normally 
defined by the coordinates x and y, for instance. Two lists 
illustrating this are shown in the following. In list 1, a 
motion vector having x-value 123 and y-value 12 is detected at 

15 instant 0. At instant 99, which corresponds to 50 seconds in 
this case, a standstill is counted that has already begun at 
instant 1, which corresponds to one second. This is a 
predefined list, that is, it allows only 100 new entries. For 
this reason, the list is newly initialized once instant 99 is 

20 reached and it is continued with the second list, which adopts 
the value. As shown, values 123 and 12 are reentered at 
instant 0 and standstill 0/0 at instant 1. However, the 50 
seconds are then added at instant 2, and counting resumes 
anew. 

25 





List 1 : 








Instant 


0 12 3 


. . . . 99 




X 123 


1 2 0 .... 


0 




Y 12 


0 3 0 .... 


0 


30 


0 :00 


0:01 0:02 0:03 


0:50 




List 1, 


newly initialized: 






Instant 


0 12 3 






X 126 


0 0 0 




35 


Y 15 


0 0 0 








0:00 0:03 0:51 0:52 
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Using this list, the object is tracked in method step 8. If a 
standstill is detected in method step 9, namely by entries O/O 
in the list, the counter is started in method step 10. If this 
is not the case, the object continues to be tracked by the 
list. However, if the counter was started in method step 10, 
it is ascertained in method step 11 whether the threshold is 
reached, which is predefined. Reaching this threshold causes a 
signaling in method step 12. In this case, the signaling may 
be implemented by means of loudspeaker 5 or display 6, that 
is, by outputting an alarm, for instance. However, if this 
threshold is not reached and the object moves again, it is 
returned to method step 8 and the tracking of the object 
resumes . 
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